Click any tag below to further narrow down your results
Links
The author builds an interactive atlas of Qwen3-1.7B's residual stream, tracking how about 1,000 question-and-answer examples across four languages and Python land in the model's internal vector space. The result is a view of language and topic structure as overlapping geometric sheets.
- The axes track language strongly, but topic structure persists after accounting for language, so the model encodes both what is discussed and how it is said.
- Code examples trace paths through partly shared regions with natural-language examples, suggesting a common geometric structure across very different text.
- The headline 17.6% figure is token-state variance under the Global PCA axes, not a measure of meaning or reasoning, and the author cautions that the sample is small, templated, and single-turn rather than real multi-turn conversation.
This arXiv paper proposes MAEMs, language models trained to turn a residual stream direction in another model into text that strongly activates it, rather than searching a fixed corpus for such text. The training signal is simply maximizing cosine similarity with the target direction, which lets the approach scale across many kinds of directions.
- A Qwen3.6-27B MAEM inverts held-out activations better than corpus search or a natural-language autoencoder, and beats corpus search at 10M tokens on most held-out languages and domains.
- It activates 89% of held-out SAE features and identifies concepts behind steering vectors roughly as well as NLAs.
- Because MAEM exemplars can be checked with a forward pass on the subject model, the method is more grounded than explanations from other metamodels.